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ABSTBACT . ' 

Gal'perin's instructional theory of prdblen solving 
is described. This theory; of stage-by-stage f ormati-on of oantal 
actions was chosen as a theoretical basis for the construction aad 
evaluation of courses in higher education^ particularly ia scieace 
and technology. A Programme of Actions and Methods CPAM) for problem 
solving in science, particularly in thermodynamics, was developed, 
and a system of heuristics was derived from it« Details on the 
instructional theory, PAH, the systems of heuristics, teaching plans, 
as veil as the main data on the process and product evaluation of the 
experimental courses are presented. (Author/JN) 



♦ . Beproductions supplied by EDBS are the best 

♦ from the original document.. 



be made * 

im 4t 4e4t4e4e4e ^^^^^^ 



Learnils and Instructior; of ProMem 
sofving © Science 

A.PULcyt/ C'CJI^-^W. Mettes/ H.J. Roossi.nk anti J-M.DcsBders 
Centre for Easacational. Research and Developr.CT^, 

Twexrte Univecs±ty of Technology ^ P.O. B»^x 2 :7, 750C AE Enschede^ 
The NefcherlaT»y>. 



Paper presensEd at the AERA Annual Meetini^, 'iBBT^::£^c& ^geli 



Manystudc 
trial and < 



aa:ve difficulties in solving 



in science. They 



methods and hope this will ^izzldiapp sufficient routine to 
enahEte them t^-pass the exam by sheer rec iiy.. ; Iam ocf ^ets problems* 
To oange i V: ^tuatioai gome teachers anrf -H^^wmiL'n n u in '975 started 
r eiiii \ hw two zscnentional first year r^on-rg ^acrr i y m y^^immiyn^'m-ir^ j^n the 



pa I i M lit of dJWiiiical Technology. 1 1 Tiik nl i TTm i>it^r<ii j\ i if ^QftS^XBOlogyl La^e^ 
on, a^xemalce courses in ElectromagpietisK Ita^Bzics vofr :startQ^ 3^ 

this lgaDj,eCt^W&SpeC±f±Ca11y fOCUSSed r^iTy^^^ j-ri^" ^ -FSi^ Umj jr^-rr^/-, i nm m i 

foar ijiiBrTiT i'' i wa l<'*Me3at^3aad valuation of inss utclL3|uux^ x" " ^^^aiBirasplving 



hx/^e^'siHtfBmcisaas^ pi i .!. im^ar ly in science ^ae 
Izi n 1 7 P* I' 'jf?^ -^il ntg'l^s should learj TSff'^Ht' 
vixlch zaqii|X!M teth a .Wi^jiLiril knowledge xat ^UEM^ a^^a^^^c; 
base (G^z^^»^ / tStd) • to ixuprove:^jw M^X0im^Bs^i^ 

tifoTiRl ci^66^iVir -31*^ iiHBe3»-->ed a system of ^»ei»u:x^::t3CK:Sar" 
inbLiu i fl plate -CQyirrir this problem3dS>lv . >^ faK^:3f 

Iir on3r:zesesECpeh.i«& i Xgi^t^ - between psycdaaA09^-<^I 



>:=«gB?;q:ingy 
ifamrledcfs 



(thinking "i7iir JMtouJ. *^'*5i[LeJ.earriing and bfi&«=4t±302: 

xn th^ ^"^T -'"iT^'nr * -^50 
area&^^ i TTTCr^g^ ^^v Ila^dc, . ^g^cribed recefrr:"^r well (La±k±ji, 198D^ ^ 





^ r ^ioftSeirt • -rlet can be spli^ :^^-4aD nree partsr 

A4^. ^thd^&^ould be Ifi'i 'iwa£; tc» promote the 

of Trn'^ilii ■ i ilirimj proo ■ 

How shnnio mt^^pts^ learrrrtfaese actiorcff^" tsz jwff'^i ids ? Which 

inst ru c L ioigl pgocm^Sures ay^l-rrML erials shorL^ji: jee 2E)lied zo get an 
optimaJ. 1 <M - <7 ^pstAGiess? 

3 . How shonjS ^ ^rasEiits of the experimental - »■ be eraJLuated? 
kind of cr±t2sr'^ saiacttid be applied on what ksiaC 5ata ^cr judging 
worth of trhe aear ± 7%f ' u ctiO T^ a l programme? 



3ach of ^H"*' aw Hi ' ^is represented in oxr:: proTSCt ^amd produced 3x 
intermediate ^ r^rrli 'i/^^ in the development and e^^^iaatq-on of the 
experimexrtzl tjoiizse. 

'!!Ste products ^of gmase» 1 were firstly the princ^aes of instructionaEl 
beaming ■zo be jxs^ :^ : course development (ChacBtsr , and seconcLp 
3trogram!ae^^ of Acrtanns a.nd Methods (PAM) for solsdngr problems in 
"^yrp rmo dy iffMii r c s f T^h!. i^^;^ developed on the basis ^ tr^se instructiMiftL 
principles and vh±ch a system of heiiris tfry ^a^a^ derived (Chaab=i-2.) 

'!Sxe instructionaC ^Ic. : consisting of the instrEdcooal procedure^ 
-aatezaals and i^^earh i TC ? activities is summaxizeci^ ^apter 3. Chasiasr^^ 
reviews the er wil^ii cs^ the data on the proc^a^^aand the results 
teaching and 
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• i mX CXPLES OF INSTRUCTIONAL LEARSTING^ 



3efbre developing the laew course we looked for «ft staralhTe t±ieoi^ 
instructional learaiisg. In our opinxon such a :tl»eot2f *tfwrlr^ carssam 

di23SBctives which relete instructioiiEri objectiaws tcp Tf i i LLa g prPfyrweS/ 

aad also learnings pcsaeesses to instructional prooetfiir&s«> 

•Dae instructional -^mrjcctives of tl» '^.eraodytaaiBics rattrse xnvql^^^ 

laeiaiioned before/ ^^atri^'^-s^ in solving ^^toblems itound TTtlier dxftics&z ^ 

students. BecacsB 3f this^ oril? i small mnaber of itheories oF 
Iflaeming were rele^jsnt^ among whici* :3ase of TtenuNpl (196HJr Gagne CT977) 
aiad^Gal'perin [Talyzl^, 1973). In ±2±s project we eventually chnsp 
G^'perxn's theory of instructional l ermrrn g ~stppl e«M 9 ntief^ with 
rsantribrrtions of Tai3=±na (1973) :ass3i Tirmrir! (19755. 
Cttar TTtaiTt reasons for cioosing this rtlhe^ir^ are : 

au. Sal'perin' s theory is the only osae exrrl i rritly tquBtraBrtlimal inrtas 
1t** ^ v^ v that Gal'perin gives a def .u^' ^ rrm cf.-^ opiricai leam±j3g ^saT^ and 
prKsxrrxbes the mi c robeha vi ou r des^>** of^ iKJ& the tac^aer antT Ln^ 
s^sdent ; 

Jb»> The learning result is consistcari;^ li f i im i.T im txxJuu of Cmpntrgn 
omaa.t±ans or actions. Acquisition of kaowtedg^ requires ti» f o r i ii rf" im . of 
amc^iate ^^pstems o± actions/ that spec: i fy w^snci^ studeat frihrmid do ^tra 
?r«^-^ problems properly/ in terms of pcCLl ifxtlar^^lgorithms and 
becristics . 

T.T. Gal ' per in 's theory of stage by stasas icin of negg^al iact±aBis 

jj a - i i Mii rTTfj to the theory of Gal*^erin C *^" jrv ' itmu 119735 there* are fottr 

» ^ ■ h PC i g i- i or parameters izr the jiei '^tflliti1 x^f as ac^cnc 
1^ Tarnu An action can . be execoBed by: 

a.* aanipulating actual objects taaterial ±ar»^ or iiWfiillY twanipulatiifc 
^ j^i i iii - ua rti a t i r^nc such as symbols (jDoaterializfiE fora)'^ 

an exanroleL of an action in maternal fcETcr , u.yntf i ng the helpr:^ an 

anz example of an action incjnateriairasfi fom is ct:h."i I . in g im- 
lipulating figures on paper^ 

Stalzaig in words or formulating how the-astriugn is execxttsd 
1). 



T . Speakiiig silently or thinking wiiihont cpeBflcfag* action is ^^Bcuted 

perfonaing mental operations (mental foa). 
2* Gp^^-^^^ -nation . An action can be directed to one c r more: diffeaBBt 
(Cs^s of) objects. 

3«> 'Compl eteness of action linlcs * An action saai ^ exeos^i^ ±n ±£3 facl - 
^^^.•iJ0fic ^r^Y, (all action links are carried oiit ^BCot«sv«5ly) or in a more 
rgbtoeviated form (certain links are carried root aft the Mtte time). 
4^ *<^tery. The execution of an action can be Troi^i or Isobb weil-mastered 
jtrifg as a consequence the rate of performance may :z±j^ "Tsr low* 



Ling is the accjuisition of new (mental) actioaSr -wd tns L m ctional ■ 
" ail n i nij is a process of planned progressive rrr-^^mal Arar-^rtn ofeextemal 
acrtions. This transformation in the form of the act i lan accoraTanied by 
cSmiges in the other three parameters. The perfionafflcaeof rhe action 
2«ssnbles more and more that of an expert i.e. ^>eotaHE5 noze transferable, 
aSifiaceviated and automatized. According to this ±heanp- of beaming the 
staaoent has to exercise in a st ^gelg^y stage proce^kxsa. 

lie l:33e beginning of this procedure the student 3h on=?r! perferm/a complete 
iXTci in material or materialized fcrm^ By observiix^ tiat -completely 

ilized performance both student anc3 tearrhpr csac vliP^pi.L incorrect or 
nplete actions and. administer feedback. Also tbay ^pst knowledge of 
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I2ie results on «ther parameters of -the- -performance^ This knowledge 

Irms r» be nsed tto achieve that the performance becomes more transferable/ 
jf^ii-ji — "t^^nptri and aasamatized* 

Aeu -iaer action: is^aastered in material or materialized form the teacher 
as21n=ss ^he student to exercise at the next form anii so on, until the 
vl i nWii s reaches ms^^sery in the mental form. 

G5»X"perin:rxioints aa^ that before starting this stage by stage exercising 
<9£ iitsm» arctaons/ tii& student must have an orienting basis to be able to 
jierfcrar the action ^r the first time. He must have information to 
acieofiS2te himself a±xj it what to do in what pircximstances* This orienting 
faaKsis should be ^^^ »»^* let^3 i*e* contain all information necessciry for a 
perfesrt performances such as the goal of the action, the composition of 
aain aerion l±nks# tbe conditions in which the action Ccin and cannot be 
pexfccmed. The best orienting basis is both complete and presented to the 
stadeart in a generalized form i*e* a fprm that covers a whole class of 
^sroblems. The quality of the orienting basis is eix5>hasized in tlxis 
'Aeory, because it outlines the conditions which are objectively 
-necesasary for the student to perform ±die action successfully i.e. to 
solve the relevant jproblems. 

^m2m Emphasis on systems of actions and 3cnowledge 

We want to emphasize the is^rtance o^ systems of actions. By t?iinking 
asloud techn\rtaes and in depth analysis of mistakes made in exams (Mettes 
^^frrr^ Pilot/ 19B0)/ we analysed difficulties students have and discovered 
»=rong deficiencn.es in the coherence of the factual and procedural 
Icctowledge of cur students. 

Tn his research on problem solving Iianda (1975) pays much attention 
tx) forming systems of actions. One way to form such a systec: is the so 
called "througg* systematization of knowledge . 

•Through" systsnatization of knowledge means combining in a single system 
ali knowledge relevant for problem solving that is contained in separate 
sections of a book, a course etc. In this way the siibject matter should 
be reorganized -in an operational form. 

Talyzina (1973) developed on the basis of Gal'perin's theory a procedure 
for the development of instruction. In this procedure systems of actions / 
subprogrammes in her terminology, occupy an iit5>ortant place. These 
subprogrammes are: 

1 . The bulk of knowledge in a particilar subject matter. 

2. The rational actions and methods of thinkii::c," ade^^iate to learning to 
apply this knowledge. This siobprogramme i? called a Programme of Actions 
and Methods. It is divided in two parts: 

a« actions and methods constituting specific types of 

thinking (specific for this' subject matter) and 
b. logical actions' and methods of thinking (not dependent 

on a concrete subject )• 

Summarizing: because we are dealing with heuristic problem solving 
the orienting basis cannot be complrte, but should be as ccanplete and 
generally applicable as possible. Such an orienting basis consists of : 
a. subject matter (knowledge) in operational form, and 

b7 heuristics and general methods of thinking , which should be derived 
from a Programme of Actions and Methods (PAM). ' ^ 
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2. THE DEVEIX)PMEOT. OF A PROGRAMME OF ACTIONS AN0 METHODS 

The. teachers in the coiirse in Thermodynamics and other specialists in 
this field could not give us an adequate description of problem solving 
in this subject matter. The literature on Thermodynamics does not contain 
any adequate system of heuristics. The situation for most subject matter 
at this moment may^ in our opinion^ well be similar. Our first a ttem pt at 
producing a PAM for Thermodynamics was based on the well known 333d widely 
used set of heuristics Polya (1957) develoj^S for problem solv±ur. In 
mathematics.* Unfortunately Polya 's heuristixs for the analysis :=f 
problems w^e too incomplete or gave hints ±ix the wrong direct±=iru For 
the transformation of the problem no adequate heuristics were &nnd and 
reasoning by analogy is not successful in tbxs type of problems^ (Mettes 
and Pilots 1980). 

So we decided to do some research on a descriptive model cf problem 
solving beha^our. The problems in our courses are called speo^ication 
problems (Mcrtes and Pilots 1980). In typ im] problems of this ^t^e of 
well-specified problems a situation/ certain^elations , variable, 
• magnitudes etc. are given^ the problem' is to find or calculate etc. one 
or more unknowns r other relations, variables, magnitudes and such- like. 
If the unknown, is found the situation is more specified. This type of 
problems i:sT7ery frequently used in science and technology curricula. 
We carried: experiments in which students as well ?s teachers tried to 
solve problCTS relevant for the course objectives* They were requested, to 
think aloud. ^ and protocols of their problem solving behaviour were 
recorded and transcribed* These protocols were interpreted in terms of a 
model derived from theories on problem solving of Duncker (1945), De 
Groot (1965)^ l^ewell and Simon (1972), in an iterative process (for 
details see Mettes and Pilot, 1980). The result of this process was a 
model (called Transformation to Standard Problem, TSP model). Although we 
derived this model from studying Thermodynamics protocols, it can be \ised 
to describe problem solving behaviour in more sxjbject matter areas in 
science and technology, with few or no. adaptions. Recently the TSP model 
was used successfully to describe protocols of problem solving in 
Electromagnetism (Van Weeren et al., 1980). 

"In the following phase we tried to develop from this descriptive model a 
prescriptive one: a Prograiitime of Actions and Methods to 1 a used in the 
training of problem solving in Thermodynamics. 

When designing this PAM^ from the TSP model we looked for actions and 
methods to ensure a systematic and effective problem solving process^ 
irrespective of whether these actions and methods were . found in the 
protocols or not. We used a number of indications and criteria for 
desirable actions and methods, such as: 

- indications from the protocols, e.g. differences in problem solving 
behaviour between students and teachers, 

- indications from the literature on special heuristics (Marples^ 1974)^ 

- indications from the literature on research on PAM's for other subject 
matter (Talyzina^ 197?; Dubovskaja^ *;967; Obuchowa ^ 1 968 ) , 

- research on frequently made mistakes and difficulties in exercises and 
exams in this course. 
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The programme has four principctlr a i nases-: 

Phase 1 : Reading the pr ol itrm tho gm »rftIy7 f:HH"^ttr'^ > «frl ygrs- 
. of the data and ^nw* uirkrwirr ty nm i rrirTr g n-nre sgheme> 

IP-base 2: Establishing wheitter or^ xa^i:— it :±5: a=:^ -tialrrr d prob- 
lem, i.e. a prc*3**w that 3aii ije- 2»^^a«^ mer^^ 
routine" opera tioiBSrT i£^30te: 

Looking for relaimras ^ ii t iib r ii t^»: ->--a aoad tlie un- 
known that Ccm be of -gse-xzr-tiw rasf^i^maatibn of 
the problem to ^ -i^'-^^""'-* ""^ _.iriK;;^:g-g7 f:5j^ersion of 
the problem ^o a ^srr^*r^m in j^^i l i 



cjoftme results. 



Phase 1 will be presented tr lu a ire xha^il rsa^ .fcrrother phases 
see Mettes et al. ^ 1980b). Wer-±irst «ect±cn : isspnxpose and then 
l±st a number <?f desired actMos. iHKt cnl? 11^ st the. actions that can 
be expressed in general tprngs^^^ox dd^j^ff^imK ,f?rpTds , different 
spe ci f i cat ions of the actinn£<^ae 7ip?in>rt» 

An exaunple of a problem in T^Tmnr^BaMics ' has been worked out . 
according to the PAM (speciSBd for •^lari iiii iljii nines) is given in 
figure 1 (see also par. 3.2)— 

Phase 1 : Analysis of the inTiTTyern 

Purpose : Getting an overall ^crctnre of the 4*ta and the 
unknown. The problezTsolwcr shouLf ^Srst xmder- 
stand the problem iwill be fo re ne s»rts solving it. 

* , 

De.r.ired actions: 

1 . 1 V Reading the problem ^^ae^ally, by pccctting a slant 

line- sifter every datrra^ 

1.2. Trcmsformation of thes^sext of *saer probieBr: into a 
scheme r using paper ^aoEi r:enrxL to develro^cm image of 
the problem situations ^-^opto ^jf ■■ a schematic survey of 
the data and unknowns- 
All data should be me?-*— aed im the scheme ^ in correct 
symbols and units. 

In some cases, plott±Kgc===slaH5txdiing a graph; this may . 
help to get a In I I i i num i iF In problem situation. 

1.3. Writing dwn the unkiiMr I T -UD ssibler in symbols. 
Estimation of the ansaes:: -proisable sign/ magnitude, dimension, 
special cases* An esths^^^^^m 'facilitates checking the answer 
later on. 

The Programme as such conta i-neg: ::z33foriratixwi that was not suitable 
to be presented to ±he studesrts- So, the next step was the. 
transformation of this Progxanome ±nto a system of heuristics that 
students can use to orientarfee- -theaieelves in problem solving. (The 
teachers can. use it also wherr gi\r±itg feedlack tc students). A stirvey 
of this system is condensed -to one page, -asually referred to as- the 
SAP chart for Thcrmoc^namics, where SAP means Systematic Approach to 
Problem solving (figure 2). 



Phase 3: Execution uf roui m*^npRrr\\ tawis* 
Phase 4: Checking the apswe=. jLnte 
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Figure 1: An exanfP^^ of a prcdDlem in Thenin u-lyii i gtiiiics 
(TG2), worked out ^rcordin^ to. the PAM. . 



•-An isolated tank, containing 1 mole of nitrogsm at lOO^ C ao^ 5 at 
is connected with ^similar tank with 2 males of carbondicoade at 
ICO^C and. 10 at. Ttss gases in the two . tanks in±r up adiabat^vally 

' and conplete- Nitrs^w-en and carbondioxide can considere d b e 
ideal gases in thrtSfe- circumstances. What is ztb^ change in 2n2=opy 
in this process \ ^ •= . J.mol" .K-^ 



WiiHc^-ct foe the »y«'«v?!'^ f^.^. rr***i*I7l*. 

7^'" * \XALYSIS 
2. xnttne 

a. system . •/ 

c. .oRtmi 
c. processes . 





'2 #«tO^« C029«l 






























PLAN' 

J u lcer relations 
u. KR-<Iurt 

b. general relation* 

c. from Uata 



t 



5. cheek lalidiry 



7 if /tor soluble 
a. other (key) relation 
. b. alternate processes 
c. assumptions 



6. Transftsrmation to standard problem 

b. relation in which anknown occms 
c spedflcation 

d.-new untoowns ^ 
5, 



T2 



->S«af-cA dt r«Le>.i«»t /S"- TJx.;,- /^/*» ) =»- i,-: "^AJj 'r*.Uti<^ car, ]ie. 



S. standard problem 



8. calntlation 
and answ'rr 



HXKCimON OF 
ROUTINh or:-P ^TIONS 
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0 r/ufA 

a. 

b. 



0^. 



if nc«;ct»Mir> . 

10, trM-kti:^ down trmtuU'S 



FigBrev2a: f 

ScteM of the Hrthod of Systenatlb Appxovlt' 
to ftoblen Solving (SA^cbart) ' 
(see.also page 8) 



Utead .^e poblen carefully 



a»Orav Unptei^ drar systerboundarles' 
:b Jrlte^inEr cfaacKterlstlcs of systent-l^oondariea. (Wrq^dopit] ^ 

c. ^ / - " contents of, system (phase^tel behavior) 

d. : • * • • the states (P,V,T,other state-varlablesj 
c. * * • " * processes (reversible,'state-var±ables 

constant? process variables «ero? 
. chea. reaction?) / 
f* " * * " other data (use correct syiolxils) 

g.If. neceaaary plot a graph (to obtain a better picture of the process) 
^ h.Hrite dmn • characteristics of the unknown . (inath.fonAlatian) ^ 
' i.Esttoate^swer (probible sign, magnitude, dimensions) 




S.ExecQte routine operations, 
have cessation and answer 
well-ordered . 



4 . Write down possibly useful key relations 
+ conditions for .validity, by looking 
from the unknown and/or data, at 

a. charts with key relations (equations 
of state, process equations) 

b. charts with non-thermo relations 

: relations which. follow directly from 
data 

5. Check relations. for their, validity in 
this problem situation ^ 



6.Conve:sion to standsrd problem 

a. Krite down-ti.e taknown using the right symbols - 

b. -Krite down a vaMd key relation in wlUch the unknown occurs 
(from list at 4) 

\c: Replace general guaatttles by specific quantities in this . 
relation 

d. Check which specific ^tities are still unkTK)wn 

e. Vrite them down^ nor unknowns 

f. T'Dien all specific quandLties are known, substitute them by 
numerical values* and tensions ^ 

7, If not soluble: 

Qieck whether Itere teat still key relitions lacki/g, dr 

b. introduce alternate processes; h:: 
' c. separate variables, fir 

d. make 'assumptions in coiaectic:! ^-i^A validity ■ 



g.Check answer against 'esti- 
mation of the unknown 
sign 

b. magnitude 

c, dimension 



^^Airproblems solved? 
yes > 

no:' 

a. fill^in answer in 

the 8cheiD9 
b -"jj^'^ther sane pro- 
gPj^isagain'appU- 



10. Check whether you made mistakes 
. on the 

'a.estimation * ' 

b. setting up the scheme , ^ 

c. writing down key -relations 

d. conversion to standard problem 

e. executing routine otjsratiohs 

Correct, then proceed to 9 
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Write these 
.down as 
tmknowns 



one or 



toore 
uzi3cnowns 



a. Write down ^he unknown 
using the right symbols 



t>. Write down a, valid 
relation in which the 
unknown is mesent 



1 



C'. Replace general 
quantities in this 
relation by specific 
quantities (e.g. 'P^fT^) 



no more 
unknowns 

__t 



For all specific known 
quantities, substitute 
values and units 



if not 



soluble 




g. Check whether 

. there are still 
relations lacking 
or 

h. Make assumptions 
, about validity 



result: standard pr6blem 
Figure 2b: , 

Diagram of Strategy: transfopnation^ using the ttnknown as starting point, 
(see also page 7) . ^ 
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The content of the heuristics is essentially .similar to the PAM^ but 
there may be considerable functional differences in form and wording^ 
of the actions and methods. The SAP chart was drawn up by the 
fallowing prij^iples : 

1. Only those neuristics were included that refer to actions iintaown 
to'the students and are strictly necessary for solving the most 
in^ortant problems. • 

2. The heiiristics had to be worded in such a way that the students 
TOuld readily understand them. * 

3. The text had to be as complete as possible, to enable the 
students to perform a complete action in materialized form. 

4. The heuristics had to be worded in such a way as to insrire the 
appropriateness throughout the course, even if the subject matter 
varies. From this general wording, ^ more specific applications - 
related to specific subject matter - had to be d^ducible. 

xS. The in^erative mood had to be used to 3how clearly that the 
heuristics Are directions for desired actions. 

. The first design of the SAP chart was checked and corrected in small ^ 
scale experiments with students. On the basis of these experiments a 
more definitive version' of the SAP chart - and conseq[uently of the 
PAM from which it was deduced - waus^ designed and used in two 
experimental courses. Based on the evaluation data of these coiirses 
the definitive version of both this PAM and the' chart was 
developed. - - . <- 

A general procedure for the construction of a PAM consists of ten 
steps that are summarized -in figure 3. Until now we have the 
in^ression that the validity of this procediire is limited by^two 
conditions: ' ^ ^ • 

1 » The problem solving co be learned must concern specification 
problems^- 

2. Fpr solving these problems it is among others necessary to use as 
tramsformations a limited set of quantitative relations. 
Within these limitations the procedure Ccin be used generally because 
of the great analogy 35etween specification problems in 
Thermodyncunics and other science subject matter areas. Empirical 
evidence has been shown by VeUi Weereii et al. (1980) and Kraii'ers et 
al. (1980 ,1981). 
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1. Collect^ a representative set of problems 
in accordance with the course ^objectives. 



I 



2. Make up a list of key relations > 



i 




Make explicit for each key-relation: 
a.. the conditions for its validity, 
b* the conditions for its usefulness, 
c* the characteristic difficulties in tlie 
^transf onration of the problem* 



Using the result o^^^ design the actions 
to be executed in the analysis of the 
problems* - , j Z 



Design actions for the evaluation of the 
solution^ ' 



Check' if transformations specific for the\ 
subject matter are necessary e.g. making 
assuT-^ptions. If so, design the actions and 
me th c^In to be executed. ' 



the 



: V ^prototype of the PAM by integrating 
z.i'C^'^.^cs of the foregoing steps. Check 
c '^nce of the programme; ^ 



Test the programme on relevant criteria 
by using it in problem solving. If possi- 
ble improve the prograirane by repeating 
step two t;o eight. ' 



5 



Test the programme in a pilot study or in 
an experimental course by transformation 
of this PAM into a system of heuristics 
for the students. Again, improve , the pro- 
gramme, if possible. \ 



M. 



Describe the"?AM to be used- in 'normal* 
instruction. ^ - 



Figure "3 : ^ 
. Summary of tljie ten steps- for the construction of a PAH. 
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3. THE* CONSTRUCTION OF AN INSTRUCTIONAL PLAN 



3,1, Instructional functions* / 

In our opinion learning theories should bridge the gap between objectives 
and procedures. We therefore restated the phases of the learning process 
in terms of instructional functions . In analogy with the concept 
•function' used in engineering design instructional functions are defined 
as ^'general -operations or actions that have to be performed in instruction 
to realize, the necessary phases of the learning process. Figure 4 gives a 
survey of the phases of the learning process in accordance with the 
theory of Gal'perin^ the instructional functions derived from them^ and 
the instructional procedures and, materials for the realization of each 
function. Details of the phases of the learning process were described in 
Chapter 1. Here we only describe how they were utilized to develop an' 
insti^ucrerohal plan. . " ^ ' 

The best way to realize an instructional function does very much depend 
o^ the specifics and context of the course. We thfnk that achieving 
realization ojp a function is more important than the specific way it is 
realized. Sliica the eaqperience of the teachers is very important for 
the l-ealizktion cf functions^ we selected procedures that differed as 
little as possible from the procedures teachers were used to in our 
university. , 

rhe instructional plan was constructed by matching procedures and 
materials with instructional functions and integrating them into a 
consistent programme. One condition was made beforehand: once devised^ 
the experimental course should not take more time from the teachers and 
students than the existing cotirse." 

Before the course started/ we organized some training sessions for the 
three teachers to get used to^the n^ procedures and materials. During 
the course/ we observed all lectures and small group activities to gather 
data for the .evaluation -of the instructional process. If there, were 
discrepancies between the planned and the actual procedures the observer 
constated the teacher about the causes for this, immediately after the 
session. Deviations frOTi the plan that endangered the rrealization of ' a 
. fxmction were as far asVpossible^. 3^ steps taken to prevent 

^' their re-'occurence. ' \^ ^ 

We will now discuss the most character^ "stic elements of the excperimental 
iiistruction: worksheet, :ey Relations, and tests. 

3^2 : SAP, chart and SAP worksheet 

The Systematic Approach to Problem solving is presented to the students 
in several ways. The most important explanSition is done by the SAP chart. 
On this chart a survey of all heuristics is condensed to one page (figure 
2). In the lectures,, these heuristics "are illustrated by problems used as 
examples. The teacher uses the heuristics regularly when explaining 
concepts and" laws in. the lectures. 

In the classes after the lectures, the students exercise by solving 
prbbiems in accordance with the heuristics as far as possible. In the 
first phases of the laming process they exercise performing the new 
actions arid methods with completeness of all action links on paper. The 
paper is a- special worksheet with a lay-out reflecting SAP. The 
heuristics are represented on this sheet by catchwords. Figure 1 shows 
sudh a worksheet, with a worked problem on it; ' ^. ' . 



dures 

^and means 



group of 20 students 



-Phays of the. learning process 

.1. Learning the conditions of the . 
. progtam of actions and methods. * 



2. Learning to 'perform the 
program of actions and 
methods. 



3. Getting knowledge of the 
. learning results. 



4« Improving the execution 
. ofPAM ' ' 



Functions of the instruction 
Orientation 

1. Presentation of the essenpal 
elements of knowledge and 
actions specific for this 
subject 

2. Making these elements of 
knowledge-and -actions 
operational 

3. Giving a system of heuristics 
for problem solving 

4. Realizing the connSctiou with 
the entering behavior 

5. Giving the student insight in 
the objectives of instruction 

Stage by stage exercising 

6. Exercising the actions and 
methods of problem solving 
(PAM) 

7. Giving feedback during 
exercises 

Testing PAM 

8. Qiecking'what learning outcome 
is reached and establishing 
whether this satisfies the 
standard 

Feedback aftera test 

9. If it is below standard: 
eliminating the cause of the 
mistakes 



3 o 



o. ^ 



51 S| =15 

O = "S3 c tS 



2- 

a. 



Bgure 4: Survey of relations between phases of the 
' ' . learning process, instructional functions* 
and the instructional procedures ai^ means 
used in the Thermodynamic courses 



14 



* SAP = systematic approach to problem 

sohdng 
••.KR « "key relation 

0 means: this procedure or means should give a main 
.•>■ . .contribution to realization of this function. 



o 
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The students in a class work individually or in small subgrocgps of 2 
or 3 students. The teacher makes his rounds / checks their work/ gives 
directions and explanation in accordance with the procedur^^trf stage by 
stage exercising (see par*1*1)* This means e.g. that he avoids showing 
the students how to do the problem^ because the students have to get 
exercise in doing the problems by themselves. Only as. a last resort 
should he actually solve a problem for a student. In general students can 
work reasonably well on their own, because they are guided by the 
heuristics ^ 

The use of the worksheets allows the teacher to closely observe the work 
of eafeh student. Conseq[uently/ the teacher is able to give precise 
feedbaArk at an early phase. Besides correcting mistakes / the teacher also 
commeirts on the learning process of the students/ e.g. when a part of the 
systematic approach is abbreviated too early in the stage by stage 
exercising (see par.1.1). 

As the course proceeds / students execute parts of SAP faster and more 
automatically. This is infact the intention, but every time new subject 
matter is introduced/ the pace is slowed down in order to enable new 
•elements to be carefully integrated: e.g. other aspects in the analysis 
and new Key Relations. 

3^3. Key Relations 

The core of the problem solving process is phase 2 of the Progrsumne of 
Actions and Methods: linking up unknown and data, using relatiotiships 
between quantities. These relationships in science and technology usxially 
result from laws, formulas^ diagrams etc. Such q[Ucintitative relationships 
are referred to as 'relations* • An important part of all. instruction* is 
the derivation, and explanation of such relal:ions. In order to be able to 
use these relations in solving problems, the student mast have at his 
disposal a structured survey of the most importeint relations. 
To be more exact: he xmist select and hold at his disposal the relations 
that are part icxilarly suitable as starting point in solving problems. 
These relations are called Key Relations . The number of. Key Relations lias 
to be kept as small as possible / becauce then it is easier to remember 
the relations and the conditions for their validity (Mettes et al. /1981) 
Key Relations*^ must be formulated in a way to insure their usefulness in 
the transformation of the problem. 

The Key Relations for a topic, and the conditions for tieir vaJ-idity, are 
written out on KR charts. An excimple of a KR chart is given in figure 5i. 

After a few lectures on a given topic the students are a^ked to design a 
KR chart for that topic. Before they start working on problems in the 
class, the teacher discusses these designs. He then hatids out his own KR 
chart and, if necessary, comments on differences between the two. 
Students use the KR charts continuously during the problem solving , 
-exercise and the teacher refers to these charts regularly when giving 
feedback. In this way, the students survey the core of the subject 
matter, use this survey to begin to master it. They also learn to obtain 
an important study skill. 

3.4. Tests * ^ 

During the course students do problems under exeuoination conditions, i.e. 
without the help of the teacher, another student or study materials and 
under pressure of time (about 30 minutes). The teacher checks the work 
£Uid writes comments concerning both the way the problem has been solved 
and, if necessary, mistakes that have been made. In the classmeeting 
after the test, these remarJcs are briefly discussed, if necessary. Then, 
under close supervision, the students who have shown insxafficient maustery 
of the preceding subject matter to be able to grasp the next topic are 
assigned additional exercises relating to that subject. In the meantime 



'Pigurei S.s.;.'-" 

Key Relations for open systems ■ i-dnf^ 0> , consisting of aa& 
coEponent, and for eqiiilibria wi-th one component. 



\ 




P.7- 



Pressure dependence 



1 • 



For ideal gcises 



For non-ideal gases 



For liquid and solid pha^s 
(approximately) 



Tenperature dependence 







More visual is: 

^ ^T^T/first transforming t^q^^P^h^J 
and then by 

transforming by 



and ^ ■ 



EQDILiBRIUM > P, T and ft equal in. the 
r whole system' 

SPONTENEOUS PROCESS ' 



T.T 



"a ■ 
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molar quantity . :r» ^^j^:^ 

fugacity - f^t^ vZ-^fugacity coefficien-t 
y^Tj^/T^ diagram (generalized fugacity _ 

— ^-^x-Z-TiT-^iiaaram^ ^ ^ ^^'^'^^^ 



o (e.g*/^^, ) means pure substance of - 

Ce-g^ /^^ ) r/." • «^ ^ at.pure zxiivere 



substance* (gaises) 



the otbex students work almost independently on priiilili«m ,in the next 
topic. With this test . -feedback system, we try to cheiac and improve 
masteE? o' a subject before proceeding to the next oBie- The tests are 
taken an 5,AP worksheets and are not graded. 

For the construction of an instructional plan also.ia general procedure, 
was developed. This procedure is based on the results of the courses m 
Thermodynamics (Mettes et al., 1980a). Evidence of the usefulness of thif. 
procedure has been shown in course development on El«»rtromag-.cti»-m (Van 
Weeren et al.,1980) and more recently on :4ecl:a^',cs. Our research and de- 
velopment is now directed to test the effectivity of this procedure for a 
quite different type of course: problem solving in political 
administration. 



4. - SDMMATIVE EVZVIiDATION. ' ' 

This chapter summarizes the results of the experimental course. The most 
important criteria for judging the worth of the instructional plan were: , 

1. The feasibility of the instructional plan: was it possible m the 
experimental course to taach^ according to this plan (the feasibility 

criterion). . 4.1. 

2. The functionality of the instructional plan: was it possible in the 
experimental course to fulfill sufficiently the instructional functions 
(the functionality criterion). . 

3. In judging the success of the experimental course we hoped above all 
that the teachers and students would prefer to teach and learii in the way 
that is. recommended in the instructional plan (satisfaction criterion). 

to assessing the quality of the PAM and the heuristi'cs on the SAP chart 
thte following six criteria are \ised: ' - 

1. the extent to which it contain^ all all ner-3ssary. action links and 

conditions ; . 

2. the appropriateness for all relevant problems of the course;- 

3. the fitness for promoting the abbreviation and automatization of- the 

performance of the actions,; 
■ 4. the ccni>rehensibility of the heuristics, . 

5. the suitability of the Assign of the charts, 

6. the acceptance by teachers and students. 

Our criteridn variables for judging the results of the -romrse were: 

1. the learning outcomes of the students, . 

2. the time teachers and students spent on tte course, 
'3. the- satisfaction of cdachers^and students- 

The original course ran fox two years {1975-amd 1976) wi LT . .ul. i ii ..7 if icati- 
on and was replaced 1^ the new course in 1977 - 1979. We took-aie first 
two years as cur 'control' groups of students. So the summative-eraluation 
involved , two control . groups (1975, 1976) and three experimental groups 
(1977,1978^, 1979). ^ ' 

The lectures and classes of all courses were observed to gather data for 
the evaluation of the instructional process, except for the- last 
experimental course in -1979. Because, of this the results of thds last 
course are considered to be representative for the. results of a course, in 
'normal' circumstances. The control courses were observed intensively to 
gather data for the construction of the experimental instructional plan 
and also to minimize differences which would. arise from observing just 
the experimental group. Other methodological aspects were described _ 
"'elsewhere (i:ettes and Pilot,. 1980 ) . 
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Sxiimnative evaluation of the PAM 
In the formative evaluation the general conclusion was that the PAM. end 
the heuristics derived from it were usefull instructional means. Only 
minor changes were proposed (Mettes and Pilot, 19J0a) . The dcftia in the 
siammative evaluation (including thinking aloud techniques after the 
experimental course in . 1979) showed that these changes were improvements- 
indeed. These data also indicated that still more explicitness on the SAP 
chart might be relevant on-some minor points: 

• the relation between analysis of the problem and the action of 
replacing general by specific quantities in the Key Relations; 

• • "hidden" Key Relations. Plidden Key Relations are general relations 
students know very well but do not think of in solving a problem, e.g. 
the relation: the sum of all fractions is one. 

We concluded that the PAM and SAP chart meet the criteria of quality. 

— 4". 2"r-S^aiamat-i ve- -eva-luatrion of th^ inst^ruct:ipnal plan 

In the first try-out of the experimental course, there were some 
deviations from the planned process so tnat both the f onctionality and' 
the feasibility of the instructional plan needed improvement. The 
feasibility of the plan had to be improved by training the teachers in 
supervising the exercising. To reach easier adaptation of the exercising 
procedure by the students PAM and the instructional plan were implemented 
in the Introductory Course in Thermodynamics in the first trimester of . 
the first year. We ^^ere convinced students then would more easily accept 
and. use the PAM and the exercising procedure because in this way the 
introduction, of PAM and^ exercising procedure was integrated in the 
introduction of the subject matter. 

As a consequence of this, the students had no possibility to develop a 
(less suitable) .way ^ of problem solving before the Thermodynamics course 
started. ' 

The changes suggested in, the formative evaluation (Mettes et al., 1980a) 
appeared to be. .Tinprovements . Especially the implementation of the 
experimental instruction into the first trimester was successfull and 
gave more time to* exercise problem' solving in the Thermodynamics course 
in the third trimester. All instructional procedures and materials were 
carried out respectively haindled sxiff iciently conform the instructional 
pl2ua. As a consecjuence of this all 'functions were sxiff iciently realized. 
It appeared however that the.extent of the subject matter to be mastered 
limited the time available for exercising in the materialized form. Also . 
the teachers had hardly enough time for dia;gnosing the mistakes made by-, " 
the stufdents. * 

From the data of the ^summative evaluation we concluded that the 
instructional plcoi met tiie criteria of feasibility and functionality. 

4.3. Summative e.valuation of t:he results 



Exam scores 

Tabel I shows the mean exam scores and the percentage sufficient marks of 
the experimental and control coxirsfets.' The scores in .the courses 1976, - 
f977 and 1979 are equated by the eqiiipercentfte conversion (Angoff 1971, 
page 564). The level of difficulty of the other examinations are not 
comparable because they may vary in difficulty.* 

The .percentages suffici^t marks of the experimentatl coxarses in 1977 and 
1979^meet o\ir standard of 70-7afer%tihose. of the control coxirse in 1976 do 
not. -F^.Tjl^ " f 

Because the entrance qualifica1i±t)5» students in the coxirses 

differed to some extent, we used ANCOVA (analysis of covariance) to 





control 


courses 


experimental 


courses 




1975. 


1976 


1977 


1978 


1979 






5. 7 


6.9 


6.1 


7.3 




1.6 


1.9 


1.7 


1.9 


1.8 


n 


19 


-43 


32 


52 


51 


% S •HI* 


54 


61 


85 


69 


79 


n 


22 


49 


33 


■ 52 


53 



Tabel I': 

Mean exam scores / standard deviations/ numbers of students and 
percentages sufficient marks • 



assess a treatment or coarse effect. The covariates in this analysis were 
the scores for the hic^ school examinations in mathesaaticS/ physics and 
chemistry/ which in The Netherlands are controlled by a central 
exauninatioi^ board. The assmnptions involve d in amalysis of covariance:. 
homogeneity of variance , normality of distribution and homogeneity of - 
regression were met (Btettes and Pilot 1980). 
The course effect is significant/ but. much more variance' is 
explained by the sum of t:he covariates. ^e variance eacplained by \ 
course effect and covariates together is less than the error 
variamce (Metites et al. /1980a). ' 

Scores on the problem solving process 

■ -> . 

The*" problem solving , process of the students, is- 2tn important criterion in 
examining the learning outcomes. The exam consisted of 13 problems . All 
A mistakeis students made were placed in categpries thai: are^ summarized in 
table II. In thi^s paper we only look at the scores of two courses (1976 
and 1979). Half of the group of students in; 1979 got the same 
examination as the students 'in 1976 so we consider identical sets of 
problems. Details of the scoring system, reliability etc. were described 
in the final report, of the project (Me ttes and Pilot, 1980). 
From this it appeared that the percentage of students that did not 
' even solve a problem in part (i.e. did not write down anything)- dropped 
from 18% in. 1976 to 5 % in the -experimental course in 1979. ( chi square = 
29.7; s=^001 two. tailed). . ' 

'Because the proble^a solvi^ng process contains several successive phases, 
one can mark up to a certain phase. As caxi be seen in tcd^le II scores are 
given up to: ' . 

. selection of; relatipns, 
♦ . tramsf ormation to standard problem, and 
. routine operations. • . 

We had, the intention also to mark the analysis of the problem , but 
could not do this because most , students wrote down in the lamination 
^ too small a; part of their actions in the analysis. In tabel II only the 
first mist2Jce a student made in each of the 13 problems is included, 
because mistakes tend .to cause further mistakeis. . 



frac 



of processes 



execntBd: wxthoixt 
inista3» T3p to indicated 
phase 



Phases of the problem 
solving process / 
and categories of 
•mistakes 



control 
course 
1976 
n = 42 



experimental 
course 
1979 A 
n = 26 



1. analysis 

2. selection of relations 

a. relation not valid 

b . relation formulated 
incorrect 

c. relation derived in- 
correct^ from data 

d. relation Ts~Tac3c"iiig— 



.64 



.78 



3. trcuisformation to 
standard problem 

a. wrong specification 

b. wrong substitution 

c. wrong alternative 
process , 

d. mistake in separating 
* vsariables 

d. routine operations 

a. wrong calcialation 

b. wrong differentiation 
or intiegration 

^mistake in vunits 



.49 



.65 



.39 



.59 



distribution Qf the 
mistakes in each phCiSe 
in percentages of 
mistakeis in that phcise 



control 
course 
1976 
n = 42 



experimental 
course 
1979 
n = 26 



12 

22 

4 
63 

67 

33' 

0 
0 

94' 



^3 : 
3 



19 



29 

11 
40 



51 
49 

0 

0 

78 

3 
17 



Tabel II- Mistakes in exams cJf two co^irses iit Thermodyaamics (control 
course, 1976 and experimental course,. 1979). Oaly the first ^mistake . 
a student made in each of the 13 prdblemis of the: -exam: included. 



In this table the fraction .is showrr of p r) c ft)lpm?°s r rl'giTTg processes that 
were executed wittout eoay mi. stedcei . ±rL~orie of tlmt^ ttrme phases. In the 
experimental r^y^ 59% of all problems are sottsrecEr-wxthout any mistake at 
aJJL. We consider -taais a very good=result for -Oic course on 
Thermo^Tjamics, bfiEaiise students/ -as we mentioTCd before / foiind it one of 
'the most difficuit: ■courses., in the firs t jear.* 

To assess the effiact: of tie. mean, scores af- the^^qgerimental course up to 
each phase apcl tfe -fHT>ai ^olution^ aga±nr^CO^ra: was .used with the same 
coTfrri a tes ^ as aijove* V . 

j;n.:ccai^arison wiJ±t:,^t±€r results in the exam scoreS/ the course effect 
ex^dns much moB^-rariance* The amount of e^^ained variance 'remains - 
ie^E2t±an' the eaoaoor 1980). 

TaKfe II also nhunm Llw iiiTT il 1 irmrinfi of the mistakes in each phase, given 
in percentages o&the:^ti*al number of nd^kes in that particxilar phase. 
ZEhe difference in:tate^:^2d C'bne or more reOations lacking)>is 
significantly le» (chi=sgaare=7.55:;: s=.02.twotailed). The other 
differences are :x^t±s^ small, which indicates that all c^iuegories of 
imistakes have beccane-a^ess- in ;about an even*i;aLte. In the 'Introductory ^ 
Course* about the same results were found (Mettes arid Pilot, 1980). 
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4«4» Time spent oh the coarse atnd satixsf.acbion 

■ The stucfents voluntarily wrote down each day the time, spent on the 
course on cOTputer cards. Only the mean ti-ae the students spent in 
the first e^qperimental course in 1977 exceeds^ the nominal time. This 
difference is* however , far too snail to.be of any significance. The 

•mecm time in the experimental and control courses also does not 
diff-^r significantly. 

Both, students and teachers were sa±±sfied with the lectures/ classes 
andoaew instructional materials (charts and worksheet). In the 
questionnaire after the course 85% of the students, answered that the 
experimrataiL treatment should be i^ teachers of similar 

courses. 

4.5. Con clusi on 

The examination scores of two ebqper i men ta 1 courses came up to the 
absolute standard of .70 to 75% sufficient marks # in one course this norm 
was almostrnnet. 

The meams of lAe exam scores of the experimental canrsfts were 
significanay higher than, tho^ the control courses. Scores on the 
problem sdaaring process showed aiso sinxSTcantly betteriiresults. There is 

no indication that students spent more time in the ea^erimental courses^ 

Both I2e2crfjffrs and students prefer with the experimental treatme n t. 
The relsultSTJo^f" the "evaluation of _ the experimental, oonrse •Introduction in 
Thermolaynamics' ±n the first trimester aire the same^w even better, we 

-will^nbt describe tJiose. results here (see Mettes and^ilot 1980). . 
Acccrdling to tEe~^rlX ej > ia f or-^thk,e5^1^tionwe c onrrTri de that the 

. eacperaaental treatment is superior -to the controipcreatment. 
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